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Abstract — Network capacity region of multi-queue multi-server 
queueing system with random ON-OFF connectivities and sta- 
tionary arrival processes is derived in this paper. Specifically, the 
necessary and sufficient conditions for the stabiiity of the system 
are derived under generai arrival processes with finite first and 
second moments. In the case of stationary arrival processes, these 
conditions establish the network capacity region of the system. 
It is also shown that AS/LCQ (Any Server/Longest Connected 
Queue) policy stabilizes the system when it is stabilizable. 
Furthermore, an upper bound for the average queue occupancy 
is derived for this policy. 



I. Introduction 

Resource allocation is one of the main concerns in the 
design process of emerging wireless networks. Examples of 
such networks are OFDMA and CDMA wireless systems in 
which orthogonal resources (OFDM subcarriers and CDMA 
codes) must be allocated to multiple users. Research in this 
area focuses on finding optimal policies to allocate orthogonal 
subchannels to the users. There are stochastic arrivals for each 
user which may be buffered to be transmitted in the future. 
Therefore, the resource allocation problem can be modeled 
as a multi-queue multi-server queueing system with parallel 
queues competing for available servers (which may model 
orthogonal subchannels fTl.f^l, [Tl,!^,!!!!,!!!!!). However, 
because of users mobility, environmental changes, fading and 
etc., connectivity of each queue to each server is changing with 
time randomly. Thus, we are faced to a multi-queue multi- 
server system with time varying channel quality for which we 
have to design an appropriate server allocation poUcy. One of 
the main performance attributes which must be considered for 
each policy is its capacity region and how much this region 
coincides with the network capacity region |8j. The capacity 
region of a network is defined as the closure of the set of 
all arrival rate matrices for which there exists an appropriate 
policy that stabiUzes the system |I8). This region is unique for 
each network and is independent of resource allocation policy. 
On the other hand, the capacity region of a specified policy, 
say TT, is the closure of the set of all arrival rate matrices for 
which vr results into the stability of the system. Obviously, 
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the capacity region of any policy is a subset of the network 
capacity region. In fact, the network capacity region of a 
system is the union of the capacity regions of all the possible 
resource allocation policies we can have for a network lH. 
A policy that achieves the network capacity region is called 
throughput optimal. 

The stability problem in wireless queueing networks was 
mainly addressed in [61, fl], fS], (9]. In f6l, authors introduced 
the capacity region of a queueing network. They considered 
a time slotted system in their work and assumed that arrival 
processes are i.i.d. sequences and the queue length process 
is a Markov process. They also characterized the network 
capacity region of multi-queue single-server system with time 
varying ON-OFF connectivities which is described by some 
conditions on the arrival traffic [7]. They also proved that for 
a symmetric system (with the same arrival and connectivity 
statistics for all the queues), LCQ (Longest Connected Queue) 
policy maximizes the capacity region and also provides the 
optimal performance in terms of average queue occupancy (or 
equivalently average delay) [fT). In [Isl, f9\ and fT3], the notion 
of network capacity region of a wireless network was intro- 
duced for more general arrival and queue length processes. 
Furthermore, Lyapunov drift techniques were applied in fSl 
and [9| to analyse the stability of the proposed policies for 
stochastic optimization problems in wireless networks. 

The problem of server allocation in multi-queue multi- 
server systems with time varying connectivities was mainly 
addressed in IT], E), Q, H, ITT1- In 12, Maximum Weight 
(MW) policy, a throughput optimal server allocation policy for 
stationary connectivity processes was proposed. However, 121 
does not explicitly mention the conditions on the arrival traffic 
to guarantee the stability of MW. References fl], f3\, f4\, plU 
study the optimal server allocation problem in terms of average 
delay. In 12, |l3l, lH, authors argue that in general, achieving 
instantaneous throughput and load balancing is impossible in 
a policy. However, as they show this goal is attainable in the 
special case of ON-OFF connectivity processes. They also in- 
troduced the MTLB (Maximum-Throughput Load-Balancing) 
policy and showed that this policy is minimizing a class of cost 
functions including total average delay for the case of two 
symmetric queues (with the same arrival and connectivities 
statistics). ifTTl considers this problem for general number of 
symmetric queues and servers. Authors in ITTI characterized 



a class of Most Balancing (MB) policies among all work 
conserving policies which are minimizing a class of cost 
functions including total average delay in stochastic ordering 
sense. They used stochastic ordering and dynamic coupling ar- 
guments to show the optimality of MB policies for symmetric 
systems. 

In this paper, we will characterize the capacity region 
of multi-queue multi-server queueing system with random 
ON-OFF connectivities and stationary arrival processes based 
on the stochastic properties of the system. Toward this, the 
necessary and sufficient conditions for the stability of the 
system is derived under a general arrival process with finite 
first and second moments. For stationary arrival processes, 
these conditions establish the network capacity region of the 
system. We also showed that a simple server allocation policy 
called AS/LCQ maximizes the capacity region i.e. its capacity 
region coincide with the network capacity region and therefore 
it is a throughput optimal policy. It is worth mentioning that 
AS/LCQ acts exactly the same as MW policy proposed in [2] 
when the connectivity process is ON-OFF in MW. 

The rest of the paper is organized as follows. Section II 
describes the model and notation required through the paper 
In section III we discuss about the strong stability definition 
in queueing networks and Lyapunov drift technique briefly. 
Then, we will derive necessary and sufficient conditions for 
the stability of our model and also find an upper bound for the 
average queue occupancy. In section IV we present simulation 
results and compare stability and delay performances of some 
heuristic work-conserving policies with those of AS/LCQ and 
the upper bound obtained in section III. Section V summarizes 
the conclusions of the paper. 

II. Model Description 
Our model in this paper is the same as the model used in 
JH, f2l, fSl, H, cm with ON-OFF connectivity processes. 
We consider a time slotted queueing system with equal length 
time slots and equal length packets. The model consists of 
a set of parallel queues C and a set of identical servers /C. 
Each server can serve at most one packet at each time slot 
and we do not allow server sharing by the queues. In other 
words, each server can serve at most one queue at each time 
slot. Assume that \C\ ^ L and |/C| = K. At each time slot 
t, the link between each queue i e {1, ...,L} and server j e 
{1,...,K} is either connected or disconnected. Assume that 
connectivity process between queue i and server j is modelled 
by an i.i.d. binary random process which is denoted by Gij {t), 
i.e. Gij{t) G {0, 1}. Suppose that pij represents the expected 
value of this process, i.e. E[Gij{t)] = pij. There are also 
exogenous arrival processes to the queues in set C. Assume 
that the arrival process to each queue i at time slot t (i.e. the 
number of packet arrivals during time slot t) is represented 
by Ai{t). For these processes we assume that E[Af{t)] < 
^max < °o foi" ^- Each queue has an infinite buffer space 
i.e. we do not have packet drops. We assume that the new 
arrivals are added to each queue at the end of each time slot. 
Let X{t) = {Xi{t), XL{t)) be the queue length process 
vector at the end of time slot t after adding new arrivals to 
the queues. Figure [T] shows the model used in this paper 



A server scheduling policy at each time slot should decide 
on how to allocate servers from set /C to the queues in set C 
This must be accomplished based on the available information 
about the connectivities Gij{t) and also the queue length 
process X{t). 




Fig. 1: Multi-queue multi-server queueing system with time 
varying connectivities 



III. Stability of Multi-Queue Multi-Server 
System with Time Varying Connectivities 

In this section, we will consider the stability problem of 
multi-queue multi-server system with ON-OFF connectivities 
for which we will find the necessary and sufficient con- 
ditions for its stability. We also show that AS/LCQ (Any 
Server/Longest Connected Queue) policy will stabilize the 
system as long as it is stabilizable. The details of this policy 
will be presented in part D of this section. At first, we will 
have a review on the notion of strong stability in queueing 
networks. 

A. Strong Stability 

We begin with introducing the definition of strong stability 
for a queueing system IH, Other definitions can be found 
in ||5l, H, Q, lfT4ll . Consider a discrete time single queue 
system with an arrival process A{t) and service process fJ,{t). 
Assume that the arrivals are added to the system at the end of 
each time slot. We can see that the queue length process X{t) 
at time t evolves with time according to the following rule. 

X{t) = {X{t-l)-f,{t))++A{t) (1) 

where outputs the term inside the brackets if it is 

nonnegative and is zero otherwise. Strong stability is given 
by the following definition [8J. 

Definition 1: A queue satisfying the conditions above is 
called strongly stable if 




Naturally for a queueing system we have the following 
definition |8|. 

Definition 2: A queueing system is called to be strongly 
stable if all the queues in the system are strongly stable. 

In our work we use the strong stability definition and from 
now we use "stabiUty" and "strong stability" interchangably. 



The following important property of strongly stable queues 
gives an invaluable insight of the above definitions. 

Lemma 1 |8|: If a queue is strongly stable and either 
E[A{t)] < A for all t or E[fi{t) - A{t)] < D where A and 
D are finite nonnegative constants, then 

lim -E[X{t)] = (3) 

t— >oo t 

A very important and useful mathematical tool used in 
network stability analysis and stochastic control/optimization 
of wireless networks is Lyapunov Drift technique. We now 
present a brief review of this technique. 

B. Lyapunov Drift 

The basic idea behind the Lyapunov stability method is to 
define a nonnegative function of queue backlogs in a queueing 
system which can be seen as a measure of the total aggregated 
backlog in the system at time t. Then we evaluate the "drift" of 
such function in two successive time slots by taking the effect 
of our control decision (scheduling or resource allocation 
policy) into account. If the expected value of the drift is 
negative as the backlog goes beyond a fixed threshold, then 
the system is stable. This is the method used in |8|, |9l, |fT2l . 
ifTOl . ||T3| . IIT4II to prove the stability of the systems working 
under their proposed policies. 

For a queueing system with L queues and queue length 
vector X{t) = {Xi{t), ...,XL{t)), the following quadratic 
Lyapunov function has been used in literature (lUl, ID, lfT2l . 
IIIU, LI4J). 

L 

V{X)=Y^X^{t) (4) 

i=l 

Assume that E[Xi{Q)] < 00, Vi = 1, 2, L and X(t) evolves 
with some probabilistic law (not necessarily Markovian). 
Then, the following important lemma holds. 

Lemma 2 [8J: If there exist constants B > Q and e > such 
that for all time slots t we have 

L 

E[V{X{t + l))-V{X{t)) \X{t)] <B~eY,Mt), (5) 

i=l 

then the system is strongly stable and further we have 

t-i L 

lim sup - V V E[X,{t)] < - (6) 

^ r=0 t=l ^ 

The left hand side of expression (|5]l is usually called 
Lyapunov drift function which is a measure of expected value 
of changes in the backlog in two successive time slots. We 
can easily see the idea behind Lyapunov method in stabilizing 
queueing systems from Lemma \. It is not hard to show that, 
when the aggregated backlog in the system goes beyond the 
bound then the Lyapunov drift in the left hand side of Q 
will be negative, meaning that the system receives a negative 
drift on the expected aggregated backlog in two successive 
time slots. In other words the system tends toward lower 
backlogs and this results in its stability. 



C. Necessary Condition for the Stability of the System 

Let hik{t) be the departure process at time slot t from queue 
i to server k. Then, we can have the following equation for 
the queue length process which shows the evolution of queue 
length process with time. 

K 

X^{t) = X,{t - I) ~Y.^-k{t) + A^{t) (7) 

k=l 

To find the necessary condition for the stability of the system, 
we need to use the following lemma. 

Lemma 3: If the system is strongly stable under some server 
allocation policy tt, then for each queue i 

t t K 

lim -^i?[A,(r)] = lim ^ ^ i?[/j,,(r)], (8) 

r=l T=lfe=l 

i.e. for a stable system the average expected arrivals to a queue 
is equal to the average expected departure from that queue. 
Proof: See appendix A. 

We now proceed to find the necessary condition for the 
stability of the system. 

Theorem 1: If there exists a server allocation policy tt under 
which the system is stable, then 

i E E ^[^^(^)] ^ ^ - E n (1 - p^fc) 

vgc{i,...,i} 

Proof: See appendix B. 

Remark: If the arrival processes Ai(t)'s are stationary, then 
= Xi for all t and therefore the left hand side of 
(|9|l will be equal to J^ieQ ^i- Consequently, the necessary 
condition for the stability of the system with stationary arrival 
processes would be 

K 

5]A, <^(1 P^fe)) Vgc (10) 

ieQ k=l ieQ 

D. Sufficient Condition for the Stability of the System 

We can divide the server allocation policy in our model into 
two scheduling problems. First, we should determine the order 
under which servers are selected for service and second, for 
each server decide to allocate it to a particular queue. Consider 
the policy that chooses an arbitrary ordering of servers and 
then for each server, allocates it to its longest connected 
queue (LCQ). In other words, in this policy we do not restrict 
ourselves with a specific ordering of servers and we accept any 
permutation of the servers according to which servers will be 
selected for service. However, for the next phase of scheduling, 
for each selected server we use the LCQ policy. We call such 
a policy as AS/LCQ (Any Server/Longest Connected Queue). 
We will now derive the sufficient condition for the stability 
of our model and prove that AS/LCQ stabilizes the system 
as long as condition (fTTI) is satisfied. An upper bound is also 
derived for the time averaged expected number of packets in 
the system. 



Theorem 2: The multi-queue multi-server system is stable 
under AS/LCQ if for all t 

K 

Y,E[Mt)]<K-Y,X{{l~P^k) VQc{l,...,i}. (11) 

iSQ k=lieQ 

Furthermore, the following bound for the average expected 
"aggregate" occupancy holds. 

t-l L 

limsup-^^S[X,(T)] < (12) 

r— t—1 

max \j2E[A{t)]-K + J2W^-P^k)\ 

Proof: See appendix C. 

It is worth mentioning that AS/LCQ acts exactly the same 
as MW policy proposed in [T] when the connectivity process 
is ON-OFF in MW. 

Note that for all the servers we only use the backlog 
information at the beginning of each time slot, i.e. during the 
implementation of AS/LCQ policy at each time slot we do 
not update the queue lengths until all the servers are allocated 
at which point we update the queue lengths. It is interesting 
to note that this policy can be non-work conserving at some 
time slots. In other words, there may exist some idle servers 
at a time slot while they could have served other backlogged 
queues. We will discuss about it through an example in part 
E of this section. 

Remark: Note that by considering stationary assumption on 
the arrival processes, the condition (fTTT l would be 

K 

^A, <X-^J](1- p,k) VQ C {1, L}. (13) 

ieQ k=l ieQ 

According to the definition of system capacity region and ( fTOl i 
and (fT3] l. equation (fTOl l characterizes the network capacity 
region of multi-queue multi-server system with stationary ON- 
OFF connectivities and stationary arrivals. 

E. Discussion 

As mentioned earlier, AS/LCQ may exhibit non-work con- 
serving behavior during some time slots. This can be clarified 
by the following example. 

Consider a system with L = 2 and K — 3 with queue length 
vector X{t) — (2,1) at time slot t. For the connectivities at 
this time we have the following matrix. 



Assume that the ordering of server selection is server 1 
first and then server 2 and finally server 3. Servers 1 and 2 
both are allocated to queue 1 according to LCQ rule. Server 
3 is connected to both of the queues. Since in AS/LCQ all 
the servers are allocated first and then the queue lengths are 
updated afterwards, queue 1 is the longest connected queue 
for server 3. Thus, server 3 is allocated to queue 1 as well. 



However, queue 1 has only two packets waiting for service 
and therefore server 3 will be idle at this time slot (although 
it could have been used to serve queue 2). 

Note that since AS/LCQ is a non-work conserving policy 
it can not be delay optimal. However, it can achieve the 
network capacity region as explained previously in part D. 
In fact, AS/LCQ wiU exhibit non-work conserving behaviour 
in light arrival loads and as the load increases its behaviour 
will converge to work conserving. Since the capacity region 
of a system is mainly determined by its behaviour in heavy 
arrival loads, this property of AS/LCQ does not have conflict 
with its throughput optimality. It is worth mentioning that not 
all work-conserving policies are throughput optimal. In the 
following section by simulations we will observe that some 
work-conserving policies cannot achieve the network capacity 
region. In the following section, we will also observe that how 
the service ordering of servers affects the average total queue 
occupancy. However, as we showed in the previous part an 
arbitrary ordering is sufficient to achieve the network capacity 
region. 

IV. Simulation Results 

Simulation is used to show the validity of our analysis 
in the previous section and also to compare performance 
of AS/LCQ to some heuristic work conserving policies in- 
cluding LCSF/LCQ (Least Connected Server First/Longest 
Connected Queue), MCSF/LCQ (Most Connected Server 
First/Longest Connected Queue), LCSF/SCQ (Least Con- 
nected Server First/Shortest Connected Queue), MCSF/SCQ 
(Most Connected Server First/Shortest Connected Queue) and 
a Randomized policy [11]. 

The LCSF (MCSF) policy at the first phase of scheduling 
(i.e. determination of servers order) will sort the servers for 
service according to their number of connectivities in an 
ascending (descending) order. The LCQ (SCQ) policy will 
assign the selected server it to its longest connected queue 
(shortest connected queue). Note that in order to make SCQ 
policies work conserving, we only serve the shortest non- 
empty queues. The Randomized policy at each time slot makes 
random server selections and for each server random non- 
empty queue selection. 

We have simulated a system consisting of 16 queues 
(L = 16) and 4 servers (K — 4). First, we considered a 
symmetric system in which all the arrivals to all the queues 
are the same in distribution. We also assumed that connectivity 
variables have the same distribution (the same connectivity 
probabilities). In this system, arrivals are assumed to have i.i.d. 
Bernoulli distributions. The capacity region for these special 
cases would be an^ n dimensional cube whose side size is 
equal to ^^^''j^ which is 0.243 for p — 0.2 and is almost 
0.25 for p = 0.9. Figures (|2]i and (|3]l show the average total 
occupancy of different policies for connectivity probabilities 
0.2, and 0.9 versus arrival rate per queue. In these figures, 
it is observed that in all the cases if the arrivals are inside 
the capacity region, AS/LCQ can stabilize the system and has 
average total occupancy below the bound we derived in the 
previous section. 
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Fig. 2: Average Total Occupancy for p ^ 0.2 
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Fig. 3: Average Total Occupancy for p = 0.9 



We can further conclude that as the connectivity variable 
increases the performance of the work conserving policies 
become the same. This agrees with intuition since when the 
system is close to full connectivity, any work conserving 
algorithm will be optimal in terms of average occupancy 
and of course better than any non-work conserving policy 
like AS/LCQ. Although AS/LCQ has larger average total 
occupancy compared to other policies, it still stabilizes the 
system as long as arrivals are inside the capacity region and 
has bounded average total occupancy. However, this is not the 
case for LCSF/SCQ and MCSF/SCQ policies and they cannot 
stabilize the system for certain arrivals inside the capacity 
region. From these figures we also see that randomized policy 
performs very close to the other policies in these special cases 
and this is due to existence of symmetry (in arrivals and 
connectivities) in these cases. 

We have also simulated an asymmetric system in which 
connectivity variables comes from the following matrix in 
which pij = E[Gij{t)]. This matrix was chosen randomly. 
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0.9 

V 0.8 



0.2 
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0.21 
0.32 
0.16 
0.45 



0.84 0.03 ^ 

0.69 0.12 

0.96 0.21 

0.13 0.07 / 



In this experiment, arrivals are following the Poisson distri- 
bution with the same rates for each slot and each queue. The 
capacity region in this case is not easy to characterize and 
describe in a concise manner. Figure (|4]i shows the results for 
this case. In this figure, we observe that Randomized policy 
could not capture the capacity region wholly. However, LCQ 
policies (AS/LCQ, LCSF/LCQ and MCSF/LCQ) performs 
similarly to each other from stability point of view. 
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Fig. 4: Average total occupancy for an asymmetric scenario 

From the above simulations, we can also observe that 
AS/LCQ performs slightly worse as compared with other 
policies in light arrival loads. This behaviour is because the 
fact that AS/LCQ may exhibit non-work conserving behaviour 
more frequently for light arrival loads. However, as the load 
increases AS/LCQ will be work conserving with high prob- 
ability. We can also observe that the obtained bound is not 
tight. 

V. Conclusions 

In this paper we derived the necessary and sufficient condi- 
tions for the stability of multi-queue multi-server system with 
random connectivities and characterized the capacity region 
of this system for stationary arrivals. We also introduced 
AS/LCQ policy and argued that although this policy is a non- 
work conserving policy, it can stabilize the system for all 
the arrivals inside the capacity region and therefore it is a 
throughput optimal policy. Then, we derived an upper bound 
of the average queue occupancy for this policy. Finally, we 
used simulations to validate our analysis and compare this 
policy to some work conserving policies in terms of average 
queue occupancy. 

If we modify the policy such that the queue lengths are 
updated after each server is allocated, we can establish a work 
conserving policy. However, this does not increase the capacity 
region for a system with stationary arrivals. However, we may 
help us to obtain a tighter bound than we obtained in this 
work. 



Appendix A 
Proof of Lemma 3 

Proof: If we write equation (|7]l for t = l,2,...,t and then 
adding them up, we will have 

t K t 

X,(t)=X,(0)-^^/i,fe(t) + ^A,(t) (14) 

r=lA,-l T=l 

Taking the expectation from both sides, dividing by t and then 
taking the limit as t goes to infinity, we will have the following. 

lim ffi^ = lim ^[^^(0)] 



t K 



t— >CX0 t 
t 



t— >-oo t 



According to Lemma 1 and the assumption that 
i?[Xi(0)] < CX3, the left hand side term and the first 
term in the right hand side term are equal to zero and 
therefore the result is proven. □ 



Appendix B 
Proof of Theorem 1 

Since the system is strongly stable, ([8]l must be satisfied for 
any subset of queues Q C {1, i}, i.e. 

/i- \ E E ^[^^(-)] = /i- 7 E E E ^['^^^(-)] (16) 

r=lieQ T=ligQ/c=l 

We now define the sets Bkir) as 

BkiT)^{GikiT),XiiT-l),iGQ} (17) 
For -Bfc(T), three disjoint cases are imaginable. 

bI{t) = {G.fe(T) = 0, i e Q}^ n {x,(t - 1) = 0, z e g} 
^fc W = {G,;fe(T) = 0, z e Q}^ n {X,(t - 1) = 0, ^ e QY 

By conditioning each term in the right hand side summation 

in (fTSI l to the event Bkir) we have 



if 



K 



k=l 



fc=i ieQ k-- 
We can easily see that 



E 



ieQ 



E 



Y,hAr)\Bi{r) 



= J = 1,2 (19) 



and 



Y,Ku{r)\Bl{r) 

leQ 



< 1 



(20) 



Note that P[BI{t)] > and for P[BI{t)], we have 

P[BUr)] = '[[{l-p,k) (22) 



Finally, from (fTST l. (ISTT i and (l22T i we conclude that 

7 E E ^[^» ^ E(i - n (1 - p^^-)) (23) 



and the theorem follows. 



fe=l igC 



□ 



Appendix C 
Proof of Theorem[2] 

Proof: We will start with the Lyapunov function evaluation, 
we will use the quadratic function (01) as our Lyapunov 
function. The Lyapunov drift for two successive time slots 
has the following form. 

E[ViXit + l))-ViXit))\Xm 

L 



E 



E 



2E 



J2xf{t + i)-xf{t)\x{t) 

i=l 
L 

1 

L 

Y^MtKMt + - x^{t)) \ x{t) 



.i=l 



(24) 



For the the first term we have: 

L 



E 



E 



E 



-2E 



J2{X,it + l)-X,it)f\X{t) 

L K 

Y,{A,{t + i)-Y,Ku{t)f\x(t) 

,i=l k=l 
L 

Y^Al{t + l)\X{t) 

i=l 

' L K 

^^^,(i + i);i,fe(i) 
=1 

jziY.h^.it)). \X{t) 



E 



(25) 



K 



Using the the fact that hik (<) > we get the following 
inequality 



fe=i 



L / K \^ / L K \^ 

i=l / k=l ) 

L K 

^^£;[/i,fc(r)] < ^(1 - P[BI{t)] - P[BI{t)]) (21) Since ^ ^ v4,(t + l)/i,fe(i) > 0, the first term in m can 



Using (fT9] l and ( |20] |. equation (fTsT l can be simplified to the 
following. 



k=l i£C 



i=l k=l 



be bounded by 



E 



J2ix.it + l)-X,it)f\X{t) 

.i=l 

<j2m-it + ^)] + K' 



summation can be rewritten as 
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Now assume that we select the servers for service according 
to an arbitrary order si, S2, sk- Thus, for the second term 
in (l24ll we have 



Y.X,Mhg,sAt + ^)\Xit),D^'' 



(31) 
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Note that 

L 

Y.X,MKs,it + l)\X{t),D^^'' 
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Therefore, equation (ISTT l can be bounded by 
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i=i k=i 

The first term in (|28]| can be written as follows. 



(28) 



Y,m)h.sS+i)\x{t) 

.i=l 

L 

>Y,iX,St)-ik-l))va:s, Hil-P,,. 
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.2 = 1 



Y^E[Mt + l)]X,{t) (29) 



1=1 j=i+i 

L L 
1=1 3=1 + 1 

For the second term in (|32]| we have 



(32) 



For the second term in (I28b we have 
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(30) 



Now, we introduce the following notation. We sort the 
queue length process at time slot t in an ascending order 
....,Xq^ , i.e. Xq^{t) > Xq^_,{t) for all i = 2,...,L 
and if Xq^{t) — Xq._-^{t), then qi > qi-i. Furthermore, 
consider the following decomposition of the connectivity pro- 
cesses for each server k. 

Dl = {G^kit + 1) = 0, for all i G {1, L}} 
D- = {Gq^kit + 1) = 1, Gq.kit + 1) - 0, 

for i<i<L and all i£{l,...,i}} 

The probability of events is given by 

L L 

PiD^0)=ll'^^-P^k) , PiDl)=Pq^k n^l-^^?"'^-) 

2=1 u=i-\-l 

In the second term of equation (|30] |. each term in the 
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and for the first term 
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Pqi^ 



(34) 



Equation ( |29] l also can be written as follows. 

L L 

^ i?[A,(t + l)]X,{t) - ^ (t + l)]Xq, (t) 

2=1 ;=i 

L L 

= J2{Xq^ (t) - Xq^^, it)) E[Aq^ i* + 1)] 

i=2 i=j 

L 

+ Xq,{t)J2mq.it+l)] (35) 
1=1 



Using equations (|28]l-(l30ll and (I32ll-(l35]) we have the fol- 
lowing bound for the second term in (l24l) . 
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,l=J k=l \ l=j 
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k=l \ 3 = 1 J J k=l 

Now, define m as 

= ornT^ riA^ -K + f^Ui^-P^'^ 

QC{1.2,...,L},t ^^^^ ^^^^^^ 

Therefore equation (l36b can be bounded by the following. 
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J=2 



X,,{t)m+^iK-l 



(37) 



Putting all together and according to ( l24l l. (|27] | and (l37b the 
Lyapunov drift in equation ( l24l l is upper bounded by the 
following. 



E[V{X{t + l))~V{X{t))\Xm 
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<Y,E[Aj{t + l)]+K^ + 2XsAt)r 



(38) 
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= J2 E[Alit + 1)] + 2K'-K- e{LXs, {t)) (39) 



where € — According to condition dTTI ). m is negative, 

therefore e > 0. Since ^ LXs^{t), therfore 

—e{LXs^{t)) < ~i^f^iXi{t). Consequently the Lyapunov 
drift (|38] | is bounded by 

E[ViXit + l))-ViXit))\Xm 
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<LAl,, + 2K^-K-eJ2Mt) 



B 



L 

1=1 



X^{t) 



in which i? that has positive value is defined as 

B = LAl„^ + 2K^ - K 



(40) 



(41) 



Therefore, according to Lemma 2, the multi-queue multi- 
server system is stable under AS/LCQ as long as condition 
(fTTl i is satisfied and also the time average expected congestion 
in the system is bounded by 



t-l L 



limsupi^X^i?[X,(r)] < - 



T=0 i=l 



which is equal to ( fT2] i. 



(42) 

□ 
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